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Abstract. We here use notions from the theory linear shift-invariant dynam- 
ical systems to provide an explicit characterization, both practical and com- 
putable, of all rational wavelet filters. For a given N, (N > 2) the number of 
inputs, the construction is based on a factorization to an elementary wavelet 
filter along with of m elementary unitary matrices. We shall call this m the 
index of the filter. It turns out that the resulting wavelet filter is of McMillan 
degree 2V(f(iV- 1) + ml. 

Moreover, beyond the parameters N and m, one confine the spectrum of 
the filters to lie in an open disk of radius p (stable filters mean p £ [0, 1] and 
for FIR take p = 0). Then all filters can be described by a convex set of 
parameters ([0, tt) x [0, 27r) 2 ( Ar - 1 ) X [0, p))'". 

Rational wavelet filters bounded at infinity, admit state space realization. 
The above input-output parametrization is exploited for a step-by-step con- 
struction (where in each, the index m is increased by one) of state space model 
of wavelet filters. 



1. Introduction 

1.1. Problem formulation - symmetries. Over decades, filters have played a 
number of roles in both signal processing and applied mathematics. Of particular 
interest have been wavelet filters [TT], [12], [30], [26], [39] . 

To describe them let T, D be the unit circle, and the open unit disk, respectively, 
i.e. 

T := {z e C : \z\ = 1 } D := {z e C : 1 > \z\ } 

(D = ID) U T is the closed unit disk) . Roughly speaking wavelet filters are matrix 
valued rational functions Sy(z) and An(z), analytic outside D, of a specific structure 
satisfying, 

(1.1) Sy(z)An(z) = I zeT. 

In signal processing terminology, An and Sy are called the "analysis" and "synthe- 
sis" filters, respectively, see e.g. [46, Fig. 9.9], [Ml Fig. 12.9-3], O Fig. 1]. The 
fact that Sy is a (left) inverse of An is referred to as the "perfect reconstruction" 
condition, see e.g. gB] Eq. (9.2)], Section 5.6]. 

This work is aimed at three different communities: mathematicians interested in 
classical analysis, signal processing engineers and system and control engineers. 
Thus adopting the terminology familiar to one audience, may intimidate or even 
alienate the other. For example what is known to engineers as McMillan degree also 
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arises in geometry of loop groups as an index. Filter banks and multi-bands from 
signal processing turn into representations of a Cuntz algebra, with the number of 
generating isometries in the Cuntz algebra equal to the number of frequency bands. 
Books like j9] , [12] and [46] and papers like [29] , [51] have made an impressive effort 
to be at least "bilingual" . Lack of space prevents us from providing even a concise 
dictionary of filter theory terms. Instead, we try to employ only basic concepts or 
indicate for references providing for the necessary background. 

Our paper is concerned with the use of time-frequency filters in the construction 
of specific wavelets, for example in i 2 (R), or in in L 2 (M. k ). The use of these filters 
offered a big boost to the list of constructive and computable approaches. The sig- 
nificance of this lies both on the theoretical side as well as the practical side; e.g., 
in adaptive wavelet approximations; as well as the building of fast computation of 
wavelet coefficients and reconstruction. Signal and image processing have typically 
been the source of time-frequency filters to be used in wavelets. Our present aim 
is to supplement this with tools from systems theory; as well as stressing the inter- 
disciplinary unity of these themes. This means we here focus on studying (wavelet) 
filters, leaving for a future work the detailed wavelet analysis going into building 
bases from filters. There are several reasons for our choice of emphasis. Firstly, 
the process of building wavelets from filters is covered in the literature; see e.g., 
[9] [lOl [TTl [12] ; but secondly, the analysis involved in this part of the subject is a sepa- 
rate endeavor. Indeed, it offers a variety of tools depending on the focus, for example 
an emphasis on the theory, as opposed to "tailoring" the basis to a specific appli- 
cation. We have omitted a detailed account of it as it would take us too far afield. 
The following sample references should help: |H1 [7| [531 1231 113 E3 113 SI1 S3 S3 ES] . 

To simplify presentation we next define wavelet filters by two symmetries: (|1.2p 



Denote by Un, with N natural, the set of N x iV-valued rational functions U(z) 
unitary on the unit circle T, i.e. 



Where U* denotes the complex conjugate transpose of U. Whenever clear from the 
context we shall omit the subscript N and simply write U. The infinite-dimensional 
group IA in (|1.2j> . is well known in literature, e.g. [1] Versions of it are studied in 
physics under the name loop-group |20j . In parts of the signal processing literature 
U is referred to as the set of paraunitary matrices, see e.g. [46] Section 5.1], [49J 
Chapter 6]. In this work we confine the discussion to the subset of U which is 
analytic outside D, the open unit disk, ("Schur asymptotically stable" in some 
communities). In electrical networks terminology, it is sometimes referred to as 
"lossless", see e.g. [49] Sections 3.5 and 14.2]. Generalizations of U to the unstable 
case, in conjunction of wavelet filters, are addressed in [2], [3]. See also Remark 4 
in Section [S] 

For N > 2, we shall find it convenient to denote by e the following iV-th root of 
unity, 



and CLl}. 



(1.2) 



U N = {U{z) : U(z)*U(z)=I N zeT}. 



(1.3) 



j2n 

e := e N . 
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We shall say that an TV x TV-valued (TV > 2) rational function F{z) belongs to Cn 
if it is of the form, 



(1.4) F(z) 



( fo(z) fo(ez) ••• fo(e"- l z) \ 
h(z) fi(ez) ■■■ fiie^z) 

\fN-i(z) f N -i(ez) ■■■ h-iie"-^)) 



with e in (|1.3|) . In signal processing literature F(z) in (|1.4[) is called a "filter bank" 
e.g. [35J Chapter 4], [35J Chapter 11]. As before, whenever clear from the context 
we shall omit the subscript TV and simply write C. 

In this work we focus our attention on wavelet filters, denoted by Wat, that is 
functions within U (|1.2[) which satisfy (jl.4[) , i.e. 

(1.5) W N ■= U N n C N . 

In terms of (|1.1[) one simply takes, 

An(z) = W(z) and Sy(z) = W 

with W £ W, see e.g. g5J Fig. 4.3-12] (recall that z = i on T). Up to Remarks 6, 
7 in Section [9j we shall not relate to (|1.1[) and only to (jl.5p . The fact that wavelet 
filters satisfy ()1.5[) has been long recognized, see e.g. [8]. In the spirit of [12], we 
here use (|1.5[) as their characterization. In signal processing literature, TV is referred 
to as "the number of bands of filter" . 

The structure of this family suggests that its description is not straightforward: 
The set U is a multiplicative group, i.e. if U\{z) and U2(z) belong to U then so is 
the product U\XJi- However, the set U is not closed under addition. In contrast, 
the set Cn in (|1.4I) is closed under both addition and multiplication by a scalar. 
However, C is not a multiplicative group, i.e. if F\(z) and F2(z) belong to C, the 
product F1F2 does not necessarily belong to this set. 

The purpose of this work is to provide an easy-to-compute characterization of all 
wavelet filters described by (jl.5l) in both presentations: input-output and state- 
space. To this end we introduce the notion of an elementary wavelet filter, i.e. a 
minimal McMillan degree element in Wn- This degree turns to be ^N(N — 1). 
A wavelet filter is then characterized as an elementary filter multiplied from the 
left by an element of Um of the form U{z N ) (in signal processing terminology, 
TV-decimated TV-expanded U, see e.g. [491 Subsection 4.1.1]). In turn, this U(z N ) 
can be factorized into m elementary members of U. We call this m the index of the 
filter. The McMillan degree of the resulting wavelet filter is TV (^(TV — 1) + m). 

1.2. Background motivation. As already pointed out, from application point of 
view wavelet filters are of interest [2], [3], [12] and the references cited there. In 
their simplest form, for discrete-time signals, the study of filters makes use of dual 
frequency variables, leading to functions of a complex variable. 

Aside from applications, the uses of filters in mathematics are manifold: In duality 
theories in harmonic analysis, see e.g., [2B], [33], [T5], [2D], [2T]; in wavelets from the 
fundamental work of Daubechies in [TH] to [35], [3], [5], [35], [3B], [53J, and other 
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families of frames and orthogonal systems [51] , [54] ; in operator theory pQ ; in op- 
erator algebras [12] , [20] , in representation theory (for examples the notion of filter 
bank we discuss is closely tied to certain representations of the Cuntz algebras) , in 
geometry (for example what we introduce below as McMillan degree also arises in 
geometry as an index); the theory of matrix functions and their factorization, see 
e.g., [42], [52], [28], [21], [30], [31], [32], [33] and the references cited there; as well 
as in mathematical physics. All of these instances are in addition related fields in 
engineering, e.g., in [5], [T2], [T3], Q3], US' [IB]; [22] the fundamental ideas have 
been influential; as well as in neighboring fields; see for example [2], [3J, [ID], [Hj . 
[48) . |49j . Even within harmonic analysis, there are several viewpoints. Some au- 
thors, for example, (see e.g., j!7j study the geometry of inner functions with the use 
of the Cuntz relations built from composition operators. By contrast, our present 
work takes as its point of departure de Branges spaces and applications to systems 
theory, see e.g., [36], OQ; and control theory, see [H], [50] . 

As already mentioned, this paper addresses different audiences: Engineers from the 
fields of system and control or from signal processing and mathematician interested 
in classical analysis. Thus, some of this work is of background nature (e.g. sections 
I3l[5l ll0p . Each section covers a theme and begins with a brief summary of the main 
ideas. 

The outline is as follows. In Section [2] we address the set C described in (|1.4I) . 
while in Section [3J the set U (|1.2I) . In Section @] wavelet filters are characterized 
in the input-output framework. The rest of the work is devoted to state-space 
realization. Relevant known background is given for general systems in Section [5] 
and for the set U in subsection 110.21 Realizations of elementary: Wavelet filters 
and unitary functions are given in Sections [6J and [7] respectively. The combination 
of both yields the realization of wavelet filters in |5J The powerful parametrization 
of wavelet filters introduced here, opens the door for future research on both sides 
Engineering and Mathematics. Sample future research topics are given in Section 
[9] Additional background is relegated to the appendix in section [POl 

Many of the ideas here are familiar to some research communities. Nevertheless, as 
far as we know, none of the results below, designated as original, appeared before. 



Here we outline (see Lemma 12. 1|) a practical and geometric characterization of the 
set C defined through the symmetry condition we introduced in (|1.4j) . 
To this end, we denote by P the following N x N permutation matrix, 



Lemma 2.1. /. A rational function F{z) is in Cn if and only if it satisfies 



2. The family Cn 




Using (11.31) note that, 

(2.1) P = [/diag{l, e, e 2 , ... , e N ^}U* , 

for some unitary U, i.e. U*U = I. Thus, in particular Pr 

P, k = I. In addition P*P = I. 



I and 



(2.2) 



F(ez) = F(z)P. 
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77. Let F a (z) and F b (z) be in Cn then, 

F b {ez)F a (ezf = F b (z)F a (z)* . 
If in addition F a (z) is invertible then, 

(2.3) F^Faiez)- 1 = F^Faiz)- 1 . 
Proof: I. One direction is clear. If 

(2.4) = (/„(*) fi(z) ... f N -i(z)). 

is in Cat, that is, it is of the form (|1.4|) . then the columns of F(ez) are cyclically 
shifted to the left by one, namely fj(z) := | : ] with j = 0, ... , N — 1, 



./iv-i^'z), 



so indeed (l2~2l holds 



Conversely if 


(l2~2l holds, 


fo(z), ... 


> the columns of F(z), see (|2.4p. 


satisfy 












/o(ez) 










= M*) 






fN-2{ez) 


= fN-l{z) 






f N -i(ez) 


= /o(*) 


and so /a (z) = 


fo(e 2 z), ■■■ 


, fN-l(z) 


= fo(e N z). Namely, F(z) is of the form 



(|1.4[) . i.e. it belongs to Cat. 

II. Substituting in (|2.2|) and using (|2.1j) yields 

F b (ez)F a (ez)* = F b (z)P (i^P)* = F 6 (z) PP*F a (z)* = F b {z)F a {z)\ 

so the first part is established. For the second part, use (I2.2p to write P = F a (z)~ 1 F a (ez). 
Substituting in (|2~2]l for F 6 (;z) yields, 

F h (ez) = F b (z)P ]p=PaW _ lF ^ z) = F b {z)F a {z)- l F a {ez). 

By assumption F a (ez) is invertible. Multiplying by F a (ez)~ 1 from the right com- 
pletes the proof. □ 



Note that the relation in (|2.3p holds whenever 

F b {z) = G(z)F a (z), 

for arbitrary invertible matrix valued rational function G(z) satisfying G(ez) = G{z). 
Note also that this is the case if one takes G to be G(z N ) (the passage from G(z) 
to G(z N ) is addressed in part 110. lj) . It turns out that this sufficient condition is 
also necessary. 

Proposition 2.2. Let F a (z) and F b (z) be inCjq with F a invertible. Then, 

I. There exists a matrix valued rational function G such that 

(2.5) F fc (z)F a (z)- 1 = G(z N ). 

II. If in addition GP = PG then also 

F a {z)- l F b {z) = G(z N ). 
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Proof: I. Denoting F := FbF^ 1 , from $Z3$i it follows that 
(2.6) F(ez) = F(z). 

The function F has a Laurent expansion 

oo 

F(z)= F ^ k 
k=—ko 

converging in a punctured disk < \z\ < r for some r > 0. Equation (12. 6ft implies 
that 

oo oo 

By uniqueness of the Laurent expansion we get that 

F k = 0, for k NZ. 

Thus, if ko > 0, we may assume without loss of generality that fco = Ntiq for some 
no G N. Thus, one can write, 

F(z) = G(z N ), 

so part I is established. 

For part II denote F = F~ 1 F} J and note that 

F(ez) = F a {ez)- l F b (ez) = (^F a (z)py 1 F b (z)P 

= P*F(z)P lpp ^ pp = V P*PF(z) =F(z). 

In a way similar to part I one obtains F — G(z N ). □ 



The proof of Proposition 12 . 21 can be mimicked to obtain the following result: 
Proposition 2.3. Let F a (z) and Fb{z) be in Cn- Then the products 

F b (z)(F a (z*))* and F b (z) (F a (l/z*))* 
are matrix valued rational functions of z N . 
Proof: Here we make use of (|2.1|) to see that for 

G(z) = F b (z) (F a (z*))* or G(z) = F b (z) (F a (l/z*))* 
we have ([2l| i.e. G(z) = G(ez). □ 

We now introduce the notion of elementary wavelet filters. To this end we need 
some preliminaries. For N > 2 let Qn be the following (constant) N x N unitary 
matrix, 



(2.7) 



1 

N 



/ e -(0-0) £ -(0-l) e -(0'2) ... g-O-(JV-l) \ 

-(1-0) £ -(l-l) e -(l-2) ... e _l.(iV-l) 

-(2-0) F -(2-l) F -(2-2) ... p -HN-l) 



c 



c -(iV-l).0 -(iV-l)-l -(JV-l)-2) ... -(N-l)-(N-l) 



For example, 
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1 -i -1 i 
1-1 1-1 
\1 i -1 -iy 

Recall that Qn is called the Discrete Fourier Transform matrix, see e.g. [9] Sub- 
section 3.1.1], 49, page 794]. Namely, if x E C N is the discrete Fourier transform 
of x £ C N , then they are related through 

x =VnQ n x x=-±=Q* n x. 
Now, we denote by U(z) the following special element of Un, 

(2.8) U N (z) :=diag|l, i , . . . , -J- 
Note that U N (z) is of McMillan degree ±N{N - 1). 

Next, using (|2.7p and (|2.8[) for AT > 2, we define the elementary wavelet filter. 

(2.9) := U N {z)Qit . 

Note that the McMillan degree of W N is as of U N , i.e. \N(N - 1). 

Corollary 2.4. /. Let F E Cjv &e given and let L(z), R(z) be arbitrary N x N 
valued rational functions, almost everywhere invertible. T/iero 

{L{z N )F(z)} and {F{z)R(z N ) : R{z N )P = PR(z N )}, 

are families in Cn ■ 

II. For given N > 2 let Wn(z) be the elementary wavelet filter in (|2.9|) . Then, 

W EC. 

Moreover, all elements in Cm are given by 

(2.10) C N = { L(z N )W N {z) : L rational, invertible }. 



Item I follows from Proposition 12.21 

II. To see that W in (|2.9[) is indeed in Cat, note that 



W(ez) = U(ez)Q = U{z) (u{z) u= )j Q = U{z)QP = W(z)P. 
Now (|2.10j) follows from item I since Wn(z) is invertible. 



3. The group U 

As already mentioned the infinite-dimensional group U is well known in literature 
see e.g. p], [11], [20], [33] and the references cited there. We here review properties 
of this set, necessary to our construction in the sequel. 

Recall that if U(z) is in the set U, then so are (U(z*))* and if stability is compro- 
mised also U(-). 



Below, L and R stand for "left" and "right" respectively. 
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To construct the set U first recall that (up to multiplication by a constant of a 
unity modulus) a unity degree, scalar, stable rational function 4> a (z) mapping T to 
itself can always be written as, 

(3.1) <f> a (z) = 1 ~ a * z aeD. 

z — a 

We shall call <f> a (z) in (13. 1 [) an elementary scalar unitary function. Every scalar 
rational function mapping T to itself of McMillan degree p, may be factored to 
elementary functions of the form (|3.ip , namely 



p 1 

n 1 



z — a,- 

3 = 1 J 

where the Oj's are not necessarily distinct. As in this rational function the poles 
are within D and the zeros are outside D, no cancellation can occur. Thus the issue 
of minimality of realization, central to system theory see e.g. [36], [44 [ Section 5.5], 
can here be avoided. 

We next extend this idea to factorize elements in Um- To this end, we need some 
preliminaries. The unit sphere in will be denoted by, 

§ w _i := {v G C N : v*v = 1}. 

We can now introduce an TV-dimensional elementary unitary matrix of McMillan 
degree one, 

/l — a*z \ 

(3.2) V{z):=I N +(— — —-ljvv*, ve§jv-i a e D. 

Recall that V(z) is a Finite Impulse Response (FIR) filter if and only if a = 0. 
For j natural, we shall find convenient to denote, 

(3.3) Vj(z) := V(z,Vj,ctj), 
with Vj G Sn-i and otj € D, parameters. 

We can cite an adapted version of [TJ Theorem 3.11], see also Eq. (14.9.2)] 

Theorem 3.1. Using (|3.3j) (up to multiplication by constant unitary matrices from 
the left and from the right) U(z) inlA^ of McMillan degree p, can always be written 
as 

(3.4) U(z) = f[V j (z). 

i=i 

We now illustrate the richness associated with U(z) in p.4p already for p = 2, 

U(z) = V(z,v 1 ,a 1 )V(z,v 2 ,a 2 ) 
Consider two "extreme" cases: 



^ + ( - 1 ) 

v2 



Viz 1 , v, a), 
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1 — a* z t 
J 2 • 

z — a * 

In particular one can use Theorem 13.11 to construct U (z) in (|2.8p by taking in 
(|3.5j) the parameters aj = and Vj = e^, the unit vectors with the appropriate 
multiplicity. Recall that the resulting Un(z) is of McMillan degree ^N(N — 1) 
(=the number of elementary unitary matrices involved). 

Before proceeding, we find it convenient to introduce the /9-scaled disk 

D p := p-B pe[0, 1]. 

We shall let a, the pole of V(z) in (13.2[) to lie within D p and thus to quantify the 
stability of the unitary matrices at hand: From arbitrary asymptotic (in fact expo- 
nential) stability corresponding to p = 1, to finite impulse response, when p = 0. 
We shall thus call p the spectral radius of the unitary matrix V(z). The spectral 
radius, p, is associated with concept of spectrum of an operator, for further motiva- 
tion and details see (|5.3I) . A word of caution, this is not to be confused with notion 
of the frequency spectrum of signals, commonly used in electrical engineering. 

Following (|3.2I) and (I3.4[) we find it convenient to introduce an N x N, N -decimated 
N -expanded elementary unitary matrix of McMillan degree N, 

(3.6) V{z N ) :=I N +( l - N a * zN -l) vv*, 

\ z" — a J 

with vj £ §/v-i an d ctj € B p parameters, for some prescribed p € [0, 1]. 

For future reference we now formulate a version of Theorem 13.11 for iV-decimated 
TV-expanded unitary matrix. 

Corollary 3.2. Let U G IAm be of the form U(z N ). Then (up to multiplication by 
constant unitary matrices from the left and from the right) using (13. 6[) it can always 
be written as, 

m 

(3.7) U(z N ) = l[V 3 (z N ). 

We shall call m the index ofU(z N ). Moreover, U(z N ) is of McMillan degree mN. 

With a slight abuse of terminology we shall refer to V(z N ) in Q3.6P as an elementary 
unitary matrix (omitting the "iV-decimated iV-expanded" qualifier) . 

In the next section we combine the above properties of the set IA along with the set 
C from Section [2 to characterize W, the set of wavelet filters. 

4. The set of Wavelet filters WW 

Our first observation on the structure of Wat, the set of TV x N wavelet filters (|1.5I) . 
is an immediate consequence of Proposition 12.21 

Proposition 4.1. Let W a (z) and Wb(z) be in Wn- Then there exists U € Un such 
that 

W b (z) = U(z N )W a (z). 



see p.6j) below. In contrast, 

(O E\ 1 ^2=0 
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Indeed, substitute unitary matrices in Proposition 12.21 so that, F a (z) — W a (z), 
F b (z) = W b (z), and G(z N ) = U{z N ). 



We next exploit Proposition 14.11 and Corollaries 12 .41 13.21 to provide an easy-to- 
compute characterization of all wavelet filters in Wn (N prescribed) taking the 
McMillan degree as a parameter. Strictly speaking the parameter will be m, the 
index of the filter, yet to be defined. The exact relation between m and the McMil- 
lan degree is given in Corollary 14.41 below. 

One can refine this parametrization and for a prescribed m, to limit the spectral 
radius of the wavelet filter to p for some p G [0, 1]. 

Theorem 4.2. /. Let W € Wn be a given wavelet filter, and let L(z N ) and R(z N ) 
be in Un ■ Then, 

{L(z N )W(z)} and {W{z)R{z N ) : R{z N )P = PR{z N )}, 
are families of wavelet filters. 

II. For given N > 2 let Wn{z) be the elementary Wavelet filter in (|2.9p . Then, 

Wn e W N - 

III. All wavelet filters are given by, 

(4.1) W N - | f J} Vj{z N ) j W N (z) : Vj E Sjv-i, a, G E 

where p G [0, 1], the spectral radius of the filter, is prescribed. 
We shall call m in (|4.1[) . the index of the filter. 

For an arbitrary given W(z) in Wn we consider equivalent all wavelet filters of the 
form 

QW(z), 

where Q varies over all constant N x N unitary matrices. 
From (|4.ip we have the following. 

Corollary 4.3. Let Wi (z), W 2 (z), W 3 {z) be m W N , then 

WiW^Wa G W N . 

The characterization of wavelet filters in (|4.1[) implies that these are matrix valued 
functions of "quantized" McMillan degrees. 

Corollary 4.4. An index m wavelet filter of dimension N is of McMillan de- 
gree, N (|(JV - l)+m) . 

Indeed, as already mentioned, the McMillan degree of Wn(z) is ^N(N — 1). From 
the construction in (|3.6p and (|4.1[) . each of the m elementary unitary matrices 
Vj(z N ) contributes N to the overall McMillan degree. 

We now wish to "count" how many wavelet filters are there. 

Observation 4.5. /. An index m wavelet filter of dimension N and spectral radius 
p, can always be parameterized as a point in the real set, 

([0, 7r)x[0, 27t) 2 ^ x [0, p)) m pe(0, 1]. 
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The set of Finite Impulse Response (FIR) filters (=zero spectral radius) may be 
parameterized by, 

([0, tt)x[0, 2«)™- 3 ) m . 
II. In the above parametrization, the set of wavelet filters is convex. 



Proof I. First, since the structure of Wn is fixed, from ()2.9[) it is clear that 
the number of free parameters in W is given by the the number of parameters in 
a unitary matrix U(z N ) in (|3.7[) . In turn, recall that each of the m elementary 
unitary matrices Vj in (|3.7[) may be identified with a point in Sn~i x [0, p). Thus, 
the number of parameters in a unitary matrix U{z N ) is given by 

(S N -i x [0, p)) m , 

and out of them, the Finite Impulse Response (FIR) filters are given by the factor, 

S AT-1 • 

Recall now that a point on v G §n—i, can be equivalently parameterized as a point 

\ 9 Af 1 I cos(5)e la \ 

in the real "box" [0, 27r)' iJV . For example, for TV = 3 one has v = C os(r,) sin(d)e ifl 

\ sin(Tj) sin(S)e 1 ^ J 

with a, f3, 7, 5, ?7 € [0, 27r). 

As we are actually interested only in elements of the form vv*, the number of 
parameters is reduced to [0, n) x [0, 2n) 2N ~ 3 . For example, in the above case of 
N = 3, without loss of generality one can take a = and S € [0, 7r). 

To complete the construction use the polar presentation of elements within a disk 
Dp in C as points in [0, 27r) x [0, p). Thus, an index 1 filter is parameterized by 

[0, tt) x [0,2vr) 2Ar - 3 x [0, 2tt) x [0, p) = [0, tt) x [0, 2v) 2{N -^ x [0, p) 

so the construction is complete. 

II. Is an immediate consequence of part I. □ 

The favorable properties of FIR filters are well known, see e.g. [1H1 Sections 2.4.2, 
beginning of 3.3]. In particular, they dramatically attenuate any noise. However, 
Observation 14.51 suggests that whenever the noise level is sufficiently low, it is not 
recommended to restrict the discussion to FIR wavelet filters: For 1 >> p > the 
filter is "almost FIR" but there are already "many more" filters than FIR's. For a 
related discussion, see also the end of Section III in [27] . 

The convex parametrization of all wavelet filters introduced in Observation ^. 5l mav 
be in particular convenient for optimization, see e.g. [15] . [27] , [4"5] and [50] . 

Following (|4.ip by multiplying from the left a given W a € Wn of McMillan degree 
N (^(N — 1) + m) , by an elementary unitary matrix V(z N ), i.e. increasing the 
index by 1, one can construct another wavelet filter Wb(z) of McMillan degree 
N(l(N + l)+m). Indeed, 

W b (z) = V(z N )W a (z), 

where V is as in p. 61) with v € Sjv-i and a € D p , parameters. 
This is illustrated next. 
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Example 4.6. Following ()2.9j) let Wi{z) be the two dimensional elementary wavelet 
filter, 

(4.2) W 2 (z) = ±= ( 

Let V a (z 2 ) in be an elementary unitary matrix of the form of (|3.6p with v =(f) 
and a parameter a £ B p , 



1 1 

1 1 



1 
±=£^ 



(4.3) y a (* 2 ) 
Clearly, it is of McMillan degree 2. 

Multiplying W2(z) from the left by U a (z 2 ) yields W a (z), a wavelet filter with N = 2 
and m = 1, i.e. of McMillan degree three, 

(4.4) W a (z) = V a {z 2 )W 2 {z) = -L ( 1 J., 2 q . J_! ) ■ 

V2 y e ( a a- a ) z(z 2 -a) / 

Next, let Vp(z 2 ) be a member of of index two (i.e. a product of a pair of 
elementary matrices of the form of p.6[) both with v =(0)) where /3 £ D p is a 
parameter, 

(4.5) Vp(z 2 ) 
Clearly, it is of McMillan degree 4. 

In turn, multiplying W a (z) in (|4.4j) from the left by Up(z 2 ) from (|4.5p . yields Wb(z), 
a wavelet filter with N — 2 and to = 3, i.e. of McMillan degree seven (see Corollary 




1 * 4 -<9 * 4 "/3 

(4.6) W b (z) = V b (z 2 )W a (z) = — 

V 2 1 l-q'z 2 q*Z 2 -l 

Note that it is only for a — (3 = that Wt(z) is a FIR filter, see Observation ^. 51 

State space realization of W2 in equation (14.21) , is given in item 1 of Example 16.11 
below. State space realizations of W a (z) and Wf,(z) in equations (|4.4[) and (|4.6p . 
respectively are given in Example 18.11 below . □ 

The rest of this work is devoted to state-space realization of wavelet filters. This 
topic has gained popularity in the last two decades, see e.g. [T3], Q3], 02] > HB]> 
[22], gS], gS], gi Section 13.4], [SO] and [SJ. In Sections [3 © below we review 
the background necessary to translate the above presented construction procedure 
of wavelet filters from matrix valued rational functions setting (input-output in 
engineering terminology) to state-space framework. 

5. State space realization - preliminaries 
Every N x N valued rational function F(z) analytic at infinity ( lim F(z) exists) 

z— ►oo 

can be written as 

F(z) = C(zI p -A)- 1 B + D, 
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A 


B ' 


C 


D 



where B 6 C? xAr anc ] C £ <C Nxp . This may be viewed as the Z-transform of 

(5.1) x(n + 1) = Ax(n) + Bu(n) y{n) = Cx(n) + Du(n), 

where u, y are TV-dimensional input and output respectively and x is p-dimensional 
(state in system theory terminology). Namely F(z) maps the Z-transform of u to 
the Z-transform of y. We find it convenient to write (|5.1|) in the (p + N) x (p + N) 
system matrix form, 

(5.2) M = 

In principle, rectangular system matrices, (i.e. the number of inputs differs from 
the number of outputs) are of interest, but they are mostly beyond the scope of this 
work, see Remark 6 in Section [9] As already mentioned, the issue of minimality of 
realization is here trivially satisfied and thus can be avoided. 

Before proceeding, recall that p{A), the spectral radius of a square matrix A, is the 
radius of the smallest disk, centered at the origin of the complex plane, containing 
the eigenvalues (=spectrum) of A. For some details, see e.g. [28] items 5.6.8-5.6.14. 
In particular, recall that for in (|5.1|) one has that there exists f3 > 1 so that for all 
natural n, 

(5.3) \\x(n)\\ Un ^ o <p\\x(0)\\p n , Vz(0) 

where p = p(A), the spectral radius of the matrix A, which in turn coincides with 
the spectral radius defined in Sections [31 [3J 

For future reference we now recall in the state space realization of a composition 
of a pair of rational functions (series connection or cascade of systems in Electrical 
Engineering terminology). Namely F&(z), F a (z) are of compatible dimensions and 
Fb{z) is obtained, 

(5.4) F b (z) = F A (z)F a (z). 

Assuming the state-space realization of each F a (z) and F\{z) is known, one can 
construct a realization of the resulting Fb(z), see e.g. [3HJ Subsection 8.3.3], [ST] 
Eq. (4.15)]. 

Observation 5.1. Given I x q and q x r valued rational functions F&(z), F a (z), 
respectively, admitting state space realization 

F a (z)^C a (zI-A a )- 1 B a + D a A a eP» xp - 

B a e O xr C a g C qX P* D a g C qxr 

F A (z)^C A (zI-A A )- 1 B A + D A A A G C PA xpA 

B A G C PAX « C A G C lxp& D A G C lxq . 

The system matrix Mb associated with the realization of Fb(z) in (|5.4[) is given by, 



' A A 


B A C a 


B A D a 





A a 


B a 


v Ca 


D A C a 


D A D a t 
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Although not central to our discussion, we comment that even when the realizations 
of F a (z) and Fa(z) are minimal, the realization in Mb is not necessarily minimal. 

We now point out that whenever A a and are upper triangular, the resulting 
Ab is upper triangular as well. Fortunately, this is indeed the case with all wavelet 
filters, see e.g. (|8.2p . the system matrix associated with Wb(z) from (|4.6[) . See also 
Remark 2 in Section O 

State space realization of unitary functions are briefly discussed in part 110.21 

We now outline the rest of this work: From the characterization of wavelet filters 
in (|4.1[) it follows that every wavelet filter of dimension N and index m is a product 
of the form 



n 



Vj(z N )W(z). 



State space realizations of elementary wavelet filters Wn{z) and of elementary 
unitary matrices Vj(z ) are given in sections [S] and [7] respectively. In section [5] we 
combine them. 



A 


B 


C 


D 



6. State space realization of elementary wavelet filters 

Recall that Wn(z), the elementary wavelet filter in (I2.9[) can be described as the 
minimal McMillan degree (= ^N(N - 1) ) filter in W N - In addition, it is a FIR 
filter. Thus, there is no surprise that there is a two stages recipe for the construction 
of M/v, the associated system matrix. 

1. We start by constructing an auxiliary permutation matrix, e.g. [28|, 0.9.5], 
denoted by Mm so that 

M N = 

First, A is the following ±N(N - 1) x ±N(N - 1) matrix, 

A = diag{Ji(0), ... , Jat-i(O)}, 

where Jfc(0) is a fc-dimensional Jordan block associated with a zero eigenvalue, e.g. 
[28| 3.1.1]. Next, D is a N x N matrix with zeroes everywhere, except a single 1 in 
the upper left corner. 

Now, C and B are constructed so that (i) the l's in each are in a descending 
staircase order, e.g. 


10 
10 
10 

and (ii) the resulting Mn is a permutation matrix. 

2. Using Q N from (j2~7]) . 



A 


BQn 


C 


DV n 



M n = M w diag{/ p , Q N } 
This is illustrated by the following. 

Example 6.1. We here consider the system matrix M^ (E 
elementary wavelet filter Wn(z) in (|2.9|) . 



A 


B ' 


C 


D 



associated with the 
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1. For N — 2, it is given by, 



M 



N 

























(o 


1 

75 




1 


1 










M N = 


( 





1 




) 




Mn = 





1 

75 




1 

75 


• 
















1 





o , 


















/ 








AT 


4, the system matrix is j 


?iven by, 


















( ° 




















1 





^ 






( 























1 

































1 



































1 







































1 

































1 




















1 

































1 





























1 


Mn 








































1 

































1 

































1 




















1 

































1 














\o 








1 

















o J 






V o 








1 









2 



-1 

2 





1 — f- 



2 





□ 



-1 

_2. 



2 \ 



-1 

2 









— I 







7. State space realization of elementary unitary matrices 

We start by showing that the system matrix associated with an elementary unitary 
matrix-valued function see (13.6[) . may be obtained from the system matrix associated 
with an elementary scalar function. 

Observation 7.1. Let V(z ), be an elementary unitary function as in (|3.6|) . i.e. 



(7.1) 



V(z N ) = I N + 



1 — a* z 



N 



1 vv* 



With the same a, let ipa{z) be the scalar unitary function, 

(7.2) V , Q (^); = i_H! =c ( z/Ar _ j4 )- 1 &, 

z" — a 

for some A £ C NxN , b £ C Nxl and c £ C lxN . 

Then the 2N x 2N system matrix M associated with V(z ) in (|7.ip is given by, 



M = 



A 



bv* 



In — (1 + a*)w* 

Indeed, it is straightforward to verify that one can equivalently write V(z N ) in (17. ip 



V(z N ) = vip a (z)v* +I N -(1 + a*)vv* = vc(zI N - A^bv* + I N - (1 + a*)vv*. 
This is illustrated next. 

Example 7.2. 1. Consider the system matrix M a associated with the scalar 
function i/j a (z N ) in (|7.2I) with N = 2. It depends on the parameter a £H) p and is 
given by, 





( v 7 " 


l 





M a ,2 = 





— \f0L 


Vi-H a 




V v/i-H 2 
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2. Now, using Observation 1 7 . 1 1 with v = (?J> the system matrix associated with the 
2x2 valued V a (z 2 ) in (I4.3[) is again depending on a and given by, 



(7.3) 



M a = 





i 


























1 







-H 2 








-a* 


) 



3. Now consider the system matrix M a associated with the scalar function ip a (z N ) 

B p and is given by, 

' 


1 

i 

-la* 



in (|7.2p with N = 4. It depends on the parameter a G 



M, 



a. 4 



a » 






1 

-a* 1 

iaJ 





o 







a ■ 







/ 



4. Next, substituting a = /3 in the above M a ,A and using Observation 17.11 with 
v = (JJ) yields the system matrix associated with Va(z 2 ) in (|4. 5[) . It depends on the 
parameter j3 £ Bp and is given by, 

/ 



(7.4) M PA 





1 











o ( 







1 



















1 

















-ipi 


Vl-l/31 2 





x/1 — I/5I 2 











-/?* 




















1 



□ 



8. A RECIPE FOR STATE SPACE REALIZATION OF WAVELET FILTERS 

Recall that in Proposition 14.11 we introduced the following construction scheme of 
wavelet filters. By multiplying from the left a given W a € Wat, of McMillan degree 
N \n(N — 1) + m) , by an elementary unitary matrix V(z N ), one can construct 
another wavelet filter Wb(z) of McMillan degree JV(±(7V + l) + m). Indeed, 

W b (z) = V{z N )W a {z), 

where V 6 U is elementary with parameters v 6 §>n-i and a € Bp, see (|3.6[) . 

Assuming the state space realization of W a (z) is already known, the state space 
realization of V(z ) is given in Example 17.21 and thus Mb, the system matrix 
associated with W b (z) can be obtained through Observation 15. II 
A somewhat similar idea appeared in [51| Section 4]. 

Example 8.1. We here construct, in two steps, the system matrix Mb associated 
with Wb(z) in (|4.6[) . a wavelet filter of dimension N = 2 and index m = 3. 

Recall that W a (z) in (|4.4[) is of McMillan degree three. Using Observation l5.11 from 
the realizations in item 1 of Example 16.11 and in (|7.3|) (item 2 in Example 17. 2j) . we 
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construct M a , the system matrix associated with W a (z), 



I ^ 1 



Mr, 



V 



/a 





/5 



-a 






1 

2 



1 




\ 



1 

V2 

~~r~ 

/ 



Next, recall that Wb(z) in (|4.6[) is of McMillan degree seven. Using Observation 
15.11 again, from the realizations in (|8.ip and in (IT.4[) (item 3 in Example 17. 2p , we 
construct Mb, the system matrix associated with Wb(z), 
(8.2) 







M b 



I 


pi 


1 





















1 





















1 



















-i/3* 






















\/a 


1 



















—y/a 









































V 














v/i-H 2 






1 - a 









\ 














































1 


i 




J% 


v/2 




13' 


/3* 




V2 


V2 


/ 









□ 



9. Concluding remarks 

1. The parameterization of all wavelet filters in Observation 14.51 has several advan- 
tages: 

• One can use the index m as a design parameter. 

• One has a clear view on the trade-off involved in increasing the index m: 
Additional degrees of freedom on the expense of computational burden, 
which is even more apparent from the state-space model. 

• The spectral radius p, is another design parameter. This point is extended 
in item 4 below. 

• p offers another the trade-off. For 1 >> p > one obtains "almost FIR" 
filters, which is a much larger family than FIR's. However, for prescribed 
m, increasing p, weakens the noise attenuation and the slows down the rate 
of convergence. 

• The set of design parameters is convex and thus convenient for design 
through optimization, see e.g. [16], [27], [50] and [48] . 

2. The stage-by-stage construction of state space realization introduced in Sections 
[3 H] is not only easy to employ, but also reveals the appealing structure of the 
realization of wavelet filters, see e.g. (|8.2|) . This is significant in facilitating the 
computations involved when one wishes to employ Matlab based algorithms such 
as LMI toolbox as proposed in e.g. [T3], [TB], [50], or solvers of the Riccati equation, 
see e.g. [13], [15] . 

3. Further properties of rational wavelet filters 
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In the present paper we concentrated on a systems-theoretic approach to a pa- 
rameterization of the family of all wavelet filters as matrix functions. There are 
important applications which we only sketch briefly here, for example: 

(a) Within the entire family, identify and analyze those wavelet filters that have 
vanishing moments; (the vanishing-moment wavelets have especially attractive al- 
gorithms for approximation!); 

(b) Give numerical recipes for how to translate our parameterization into wavelet 
functions on the real line or on more general ambient spaces, so obtaining scal- 
ing functions, wavelet generators (father/mother functions) and associated wavelet 
bases from our filter matrix-functions. 

Both (a) and (b) are major topics in wavelet theory, see e.g. O |23l EH [25j l37j 

sni sn sa szi Eg. 

4. Relaxing Schur stability (taking p > 1) 

In the description of the set U in (jl.2l) we confined the discussion to Schur asymp- 
totically stable functions, i.e. analytic outside D p for some prescribed p € [0, 1]. 
Consequently, in the stage- by- stage construction of IA in Section [3j we take the 
poles to be within B p . 

However, in some applications this requirement is not imperative, e.g. where the 
filters are not associated with dynamical systems. Then, one can extend the dis- 
cussion and allow the poles of a function in U to be in D p \ T, for some p > 1, see 
e.g. [U Section 3] and in the framework of wavelet filters see [2], [3]. 

5. Not necessarily rational wavelet filters. 
Equation (|3.6|) may be substituted by, 

V(z N ) :=I N + (iP(z N )-l)vv*, 

where v £ §zv-i is a parameter and the scalar function i})(z), mapping T to itself, 
is with the appropriate analyticity conditions, e.g. meromorphic outside D. For 
example, one can take 

which maps the open unit disk to itself. 

Thus, if W(z) is a wavelet filter satisfying (jl.5p . then so is the product 

V{z N )W{z). 

A thorough study of non rational generalizations of wavelet filters can be found in 

m- 

6. Non-square wavelet filters 

The property C defined in (| 1 .4[) can in fact be generalized to having 
//„(«) h(ez) ■■■ f (e N - 1 z)\ 

hi.*) A(«o ••• hi^-'z) 

F (z) = . 

\fi-i(z) fi-i(ez) ■■■ /UCe"- 1 *)/ 
satisfying the condition (|2.2p . 

F(ez) = F{z)P, 
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where P is as before. 

Now for the requirement on T we return to (jl.ip . For N > I, this requirement is 
generalized to coisometry FF* = Ii . 

If however I > N (in signal processing literature this is referred to as the "over- 
sampling" case. In other places "frames" are discussed) we return to and 
take, 

An(z) = F(z) Sy{z) = (f (J-^ F(z)j ■ F 

In particular, Sy(z) is a left inverse of An(z), on T. For mathematical analysis of 
this case see e.g. [2J, [33]. From engineering point of view this case is addressed in 
a series of papers [T3J , [2] , [TS] , [TB] . 

7. Relaxing the condition (jl.ip on all T. 

One can require that SyAn w / only on part of T. This leads to "wavelets on 
fractals", see e.g. [H], [20], EH- See also [27]. 

10. Appendix -additional background 




10.1. The Z-transform of iV-decimated TV-expanded sequence. We next ad- 
dress the passage from G(z) to G(z N ) and recall in the following background. Let 
{ a fc}fc°=-oo be a sequence. For a natural N, its decimated version is the sequence, 
{bk}kL-oc with bk — ciNk- The N-expanded version of {b^kL-oo is the sequence 
{ c k}kL-oo where all elements are zero, except CNk — bk- Alternatively, one can 
write that all elements in {cfe}^L„ oc are zero, except CNk = a>Nk, see e.g. [46l 
Chapter 3], [49], Subsection 4.1.1]. 

Now, we recall that if the Z-transform of {ak)% x L_ 00 exists and denoted by F(z), 
the Z-transform of {ck}% x L_ 00 exists and is given by F(z N ). Indeed, assume that 
{ a k\kL-oo i s so that all elements to the left of £J-fc„, for some positive finite k , 
vanish. Thus, {a^} can be written as a sum A_ + A + with A_ = {a,k}1=~k an< ^ 
A + = {afe}j°. Clearly, the Z-transform of A_, denoted by F_(z) is well defined 
and is rational. Assume in addition that the Z-transform of A +1 denoted by F+(z), 
is rational. Then, the fact that the ^-transform of {ck}1 = -k exists and is rational, 
is obvious. Now to see that also Z-transform of {ck}kLi exists and is rational we 
examine the associated Hankel matrices. Let H a and H c be the Hankel matrices 
associated with {ak}%%i and {cfc}j£L x , respectively, e.g. 



ail ai2 ai 3 a i4 a iB ai 6 a i7 

0.12 0,13 a 14 &15 &16 &17 a 28 

■ <M3 ai4 ais ai6 an 02s ^38 

H a — an 015 ai 6 an a 2 s a 38 «48 

ais ai6 017 a 2 8 &38 043 053 

aiQ aij a28 038 a48 a 58 a 68 

an a 2 8 03s 048 a 58 a 68 a 78 , 



/ an 014 ai7 \ 
In n „,. 017 \ 



H r = 



014 

a i4 ai7 

ai4 017 a^$ 

017 a 48 

ai7 a 48 

a 48 a ra 



an 
\an 



Taking 



one can always write, 



E := 



/1000000 

10 
Vo 1 



EH n E* = EH r E* 



E*hE 



( an Ql4 ai7 \ 
I ai4 a i7 a 48 
V «17 Q48 f78 / 



Namely, h is another Hankel matrix. This implies that 

rank(H c ) = mnk(E*hE) = rank(ft) < rank(# a ). 
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By assumption the rank of H a is finite then so is rank(_ff c ), which implies that both 
{ a k}kLi and {ck}kLi admit state space realization, see e.g. [36l Lemma 6.5-7], [44] 
Lemma 5.5.5] and thus the Z-transform of each sequence exists and is rational. 

10.2. Functions in U admitting state space realization. We first cites an 
adapted version of [TJ Theorem 3.9] (a closely related result appeared in [22J The- 
orem 3]) 

Theorem 10.1. Let U(z) analytic at infinity, be of McMillan degree p, and let 

U{z) = C(zl — A)~ l B + D 
be a minimal realization of U . Then, 

U eU N 

if and only if there exists a p x p non-singular Hermitian matrix H ( uniquely de- 
termined from the given realization) such that 

( A BY* ( H \ ( A B \ ( H \ 

\C D ) \ In J (C D ) — \ I N ) ■ 

This H is called the Hermitian matrix associated (with the given minimal realiza- 
tion). 

Using the system matrix M notation from (|5.2I) , the Stein Equation in Theorem 
110.11 can be compactly written as 

M*HM = H H := diag{i?, I N }. 
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